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Abstract — In this paper, an expression for the asymptotic 
growth rate of the number of small linear-weight codewords of 
irregular doubly-generalized LDPC (D-GLDPC) codes is derived. 
The expression is compact and generalizes existing results for 
LDPC and generalized LDPC (GLDPC) codes. Assuming that 
there exist check and variable nodes with minimum distance 2, 
it is shown that the growth rate depends only on these nodes. An 
important connection between this new result and the stability 
condition of D-GLDPC codes over the BEC is highlighted. Such 
a connection, previously observed for LDPC and GLDPC codes, 
is now extended to the case of D-GLDPC codes. 

Index Terms — Doubly-generalized LDPC codes, irregular code 
ensembles, weight distribution. 

I. Introduction 

Recently, low-density parity-check (LDPC) codes have been 
intensively studied due to their near-Shannon-limit perfor- 
mance under iterative belief-propagation decoding. Binary 
regular LDPC codes were first proposed by Gallager in 1963 
|[l]. In the last decade the capability of irregular LDPC 
codes to outperform regular ones in the waterfall region of 
the performance curve and to asymptotically approach (or 
even achieve) the communication channel capacity has been 
recognized and deeply investigated (see for instance IS], O, 

H, 0, 161, iTl). 

It is usual to represent an LDPC code as a bipartite graph, 
i.e., as a graph where the nodes are grouped into two disjoint 
sets, namely, the variable nodes (VNs) and the check nodes 
(CNs), such that each edge may only connect a VN to a CN. 
The bipartite graph is also known as a Tanner graph IS). In 
the Tanner graph of an LDPC code, a generic degree-g VN 
can be interpreted as a length-g repetition code, as it repeats q 
times its single information bit towards the CNs. Similarly, a 
degree-s CN of an LDPC code can be interpreted as a length-s 
single parity-check (SPC) code, as it checks the parity of the 
s VNs connected to it. 

The growth rate of the weight distribution of Gallager's 
regular LDPC codes was investigated in HI. The analysis 
demonstrated that, provided that the smallest VN degree is 
at least 3, for large enough codeword length N, the expected 
minimum distance of a randomly chosen code in the ensemble 
is a linear function of N. 



More recently, the study of the weight distribution of 
binary LDPC codes has been extended to irregular ensembles. 
Important works in this area are Ig), ifTOl . ifTTI . In ifTTI a 
complete solution for the growth rate of the weight distribution 
of binary UTegular LDPC codes was developed. One of the 
main results of ifTTl is a connection between the expected 
behavior of the weight distribution of a code randomly chosen 
from the ensemble and the parameter A'(0)p'(l), X{x) and 
p{x) being the edge-perspective VN and CN degree distribu- 
tions, respectively. More specifically, it was shown that for a 
code randomly chosen from the ensemble, one can expect an 
exponentially small number of small linear-weight codewords 
if < A'(0)p'(l) < 1, and an exponentially large number of 
small linear-weight codewords if A'(0)p'(l) > 1. 

This result establishes a connection between the statistical 
properties of the weight distribution of binary irregular LDPC 
codes and the stability condition of binary irregular LDPC 
codes over the binary erasure channel (BEC) 111, H. If q* 
denotes the LDPC asymptotic iterative decoding threshold 
over the BEC, the stability condition states that we always 
have 



q* < [A'(0)p'(l)]" 



(1) 



Prior to the rediscovery of LDPC codes, binary generalized 
LDPC (GLDPC) codes were introduced by Tanner in 1981 |8l. 
A GLDPC code generalizes the concept of an LDPC code in 
that a degree-s CN may in principle be any (s, h) linear block 
code, s being the code length and h the code dimension. Such 
a CN accounts for s — h linearly independent parity-check 
equations. A CN associated with a linear block code which is 
not a SPC code is said to be a generalized CN. In |8| regular 
GLDPC codes (also known as Tanner codes) were investigated, 
these being GLDPC codes where the VNs are all repetition 
codes of the same length and the CNs are all linear block 
codes of the same type. 

The growth rate of the weight distribution of binary GLDPC 
codes was investigated in ifTH. ifTSll. lfT4ll. ifBll. In lfT2ll the 
growth rate is calculated for Tanner codes with BCH check 
component codes and length-2 repetition VNs, leading to 
an asymptotic lower bound on the minimum distance. The 
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Fig. 1. Structure of a D-GLDPC code. 



same lower bound is developed in fT3l assuming Hamming 
CNs and length-2 repetition VNs. Both works extend the 
approach developed by Gallager in |1, Chapter 2] to show 
that, for sufficiently large N , the minimum distance is a linear 
function of N . The growth rate of the number of small weight 
codewords for GLDPC codes with a uniform CN set (all CN 
of the same type) and an irregular VN set (repetition VNs 
with different lengths) is investigated in 1.14] . It is shown 
that for sufficiently large N , a minimum distance increasing 
linearly with N is expected when either the uniform CN set 
is composed of linear block codes with minimum distance at 
least 3, or the minimum length of the repetition VNs is 3. 
On the other hand, if the minimum distance of the CNs and 
the minimum length of the repetition VNs are both equal to 2, 
then for a randomly selected GLDPC code in the ensemble we 
expect a minimum distance growing as a linear or sublinear 
function of N (for large N) depending on the sign of the first 
order coefficient in the growth rate Taylor series expansion. 
The results developed in |14| were further extended in [15] to 
GLDPC ensembles with an irregular CN set (CNs of different 
types). It was there proved that, provided that there exist CNs 
with minimum distance 2, a parameter A'(0)C, generalizing 
the parameter \'{{))p'{l) of LDPC code ensembles, plays in 
the context of the weight distribution of GLDPC codes the 
same role played by A'(0)p'(l) in the context of the weight 
distribution of LDPC codes. The parameter C is defined in 
Section Unl 

Interestingly, this latter results extends to binary GLDPC 
codes the same connection between the statistical properties 
of the weight distribution of irregular codes and the stability 
condition over the BEC. In fact, it was shown in |16| that the 
stability condition of binary irregular GLDPC codes over the 
BEC is given by 

q* <[\'{Q)C]-\ (2) 

Generalized LDPC codes represent a promising solution for 
low-rate channel coding schemes, due to an overall rate loss 
introduced by the generalized CNs [17]. Doubly-generalized 



LDPC (D-GLDPC) codes generahze the concept of GLDPC 
codes while facilitating much greater design flexibility in terms 
of code rate ifTSl (an analogous idea may be found in the 
previous work {19\). In a D-GLDPC code, the VNs as well 
as the CNs may be of any generic linear block code types. A 
degree-q VN may in principle be any [q, k) linear block code, 
q being the code length and k the code dimension. Such a VN 
is associated with k D-GLDPC code bits. It interprets these 
bits as its local information bits and interfaces to the CN set 
through its q local code bits. A VN which corresponds to a 
linear block code which is not a repetition code is said to be a 
generalized VN. A D-GLDPC code is said to be regular if all 
of its VNs are of the same type and all of its CNs are of the 
same type and is said to be irregular otherwise. The structure 
of a D-GLDPC code is depicted in Fig. [T] 

In this paper the growth rate of the weight distribution 
of binary irregular D-GLDPC codes is analyzed for small 
weight codewords. It is shown that, provided there exist 
both VNs and CNs with minimum distance 2, a parameter 
1/P^^(1/C) discriminates between an asymptotically small 
and an asymptotically large expected number of small linear- 
weight codewords in a D-GLDPC code randomly drawn from 
a given irregular ensemble (the function P{x) is defined 
in Section HiHi. The parameter 1/P^^(1/C) generalizes the 
above mentioned parameters X'{0)p'{l) and A'(0)C to the case 
where both generalized VNs and generalized CNs are present. 
The obtained result also represents the extension to the D- 
GLDPC case of the previously recalled connection with the 
stability condition over the BEC. In fact, it was proved in lfT6l 
that the stability condition of D-GLDPC codes over the BEC 
is given by 

q*<P-\l/C). (3) 

The paper is organized as follows. Section |ll] defines the D- 
GLDPC ensemble of interest, and introduces some definitions 
and notation pertaining to this ensemble. Section |lll] defines 
further terms regarding the VNs and CNs which compose the 
D-GLDPC codes in the ensemble. Finally, Section |IV] states 
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and proves the main result of the paper regarding the growth 
rate of the weight distribution. 

II. Irregular Doubly-Generalized LDPC Code 
Ensemble 

We define a D-GLDPC code ensemble as follows, 
where n denotes the number of VNs. There are different 
CN types t e Ic = {1,2,- •■ ,nc}, and different VN 
types t G ly = {1,2,- ■• ,ny}. For each CN type t G I^., 
we denote by ht, St and rt the CN dimension, length and 
minimum distance, respectively. For each VN type t ^ ly, 
we denote by kt, qt and pt the VN dimension, length and 
minimum distance, respectively. For t e Ic, pt denotes the 
fraction of edges connected to CNs of type t. Similarly, for 
t € ly, Af denotes the fraction of edges connected to VNs of 
type t. Note that all of these variables are independent of n. 

The polynomials p{x) and A(x) are defined by 
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and 
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If E denotes the number of edges in the Tanner graph, the 
number of CNs of type t G /c is then given by Ept/st, and 
the number of VNs of type t G is then given by EXt/qt- 
Denoting as usual p{x) dx and A(x) dx by J p and J A 
respectively, we see that the number of edges in the Tanner 
graph is given by 

and the number of CNs is given hy m = E J p. Therefore, 
the fraction of CNs of type t G Ic is given by 



It 



Pt 



stj P 



and the fraction of VNs of type t G /t, is given by 

Xt 



6t = 



(4) 



(5) 



Also the length of any D-GLDPC codeword in the ensemble 
is given by 



N 



tei^ 



EXt 

qt 



(6) 



Note that this is a linear function of n. Similarly, the total 
number of parity-check equations for any D-GLDPC code in 
the ensemble is given by 



M 



m \ - Ptht 



A member of the ensemble then corresponds to a permutation 
on the E edges connecting CNs to VNs. 



The growth rate of the weight distribution of the irregular 
D-GLDPC ensemble sequence {A^n} is defined by 



G{a) = lim -logE^,, [N^ 



(7) 



where E7vi„ denotes the expectation operator over the ensem- 
ble AAn, and Nyj denotes the number of codewords of weight 
w of a randomly chosen D-GLDPC code in the ensemble A4„. 
The limit in (|7|i assumes the inclusion of only those positive 
integers n for which an G Z and EA<„[-^an] is positive (i.e., 
where the expression whose limit we seek is well defined). 
Note that the argument of the growth rate function G{a) is 
equal to the ratio of D-GLDPC codeword length to the number 
of VNs; by this captures the behaviour of codewords linear 
in the block length, as in ITTl for the LDPC case. 

Definition 2.1: An assignment is a subset of the edges 
of the Tanner graph. An assignment is said to have weight k 
if it has k elements. An assignment is said to be check-vaUd 
if the following condition holds: supposing that each edge of 
the assignment carries a 1 and each of the other edges carries 
a 0, each CN recognizes a valid codeword. 

Definition 2.2: A spUt assignment is an assignment, to- 
gether with a subset of the D-GLDPC code bits (called a 
codeword assignment). A split assignment is said to have split 
weight {u, v) if its assignment has weight v and its codeword 
assignment has u elements. A split assignment is said to be 
check-valid if its assignment is check-valid. A split assignment 
is said to be variable-valid if the following condition holds: 
supposing that each edge of its assignment carries a 1 and 
each of the other edges carries a 0, and supposing that each 
D-GLDPC code bit in the codeword assigment is set to 1 and 
each of the other code bits is set to 0, each VN recognizes an 
input word and the corresponding valid codeword. 

Note that for any D-GLDPC code, there is a bijective corre- 
spondence between the set of D-GLDPC codewords and the set 
of split assignments which are both variable-valid and check- 
valid. 

III. Further Definitions and Notation 

The weight enumerating polynomial for CN type t ^ Ic is 
given by 



u=0 



Here ^1* ^ > denotes the number of weight-u codewords for 
CNs of type t. Note that Ar^ > for all t e h- The bivariate 
weight enumerating polynomial for VN type < G /„ is given 
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by 



11=0 v=0 

u—l v—pt 

Here Bu)u > denotes the number of weight-w codewords 
generated by input words of weight u, for VNs of type t. Also, 
for each t e ly, corresponding to the polynomial B^^^x^y) 
we denote the sets 



St^{[i,j)^I? : >0} 



(8) 



and 



5r=5A{(0,0)}. (9) 
We denote the smallest minimum distance over all CN types 

by 

r = min{rt : t G /c} 
and the set of CN types with this minimum distance by 

We also define 



Ct = 



St 



for each t E Ic, and 



tex^ 



(10) 



We note that Ct > for all t e Ic, so C > 0. 

Similarly, we denote the smallest minimum distance over 
all VN types by 

p = min{pf : t E Iv} 
and the set of VN types with this minimum distance by 

= {te ly : pt=p} . 

In the specific case where p = 2, we also introduce the 
following definitions. For each t e X^, define the set Lt = 
{i G Z : sfl > 0} - note that these sets are nonempty. Also 
define the polynomial P{x) by 



2B 



it) 



(11) 

tex^ ieLt 

and denote its inverse by P^^{x). Since all the coefficients 
of P{x) are positive, P{x) is monotonically increasing and 
therefore its inverse is well-defined and unique. Note that in 
the case r = p — 2, both C and the polynomial P{x) depend 
only on the CNs and VNs with minimum distance equal to 2. 

Finally, note that throughout this paper, the notation e — 
exp(l) denotes Napier's number. 



IV. Growth Rate for Doubly-Generalized LDPC 
Code Ensemble 

The following theorem constitutes the main result of the 
paper 

Theorem 4.1: Consider an irregular D-GLDPC code en- 
semble sequence M.n satisfying r ^ p ~ 2. For sufficiently 
small a, the growth rate of the weight distribution is given by 



G{a) — a log 



1 



P-i(l/C) 



+ 0{a') 



(12) 



The theorem is proved next. For ease of presentation, the proof 
is broken into four parts. 

A. Number of check-valid assignments of weight em over 7m 
CNs of type t E Ic 

Consider 7m CNs of the same type t £ Ic- Using generating 
functions Q , the number of check-valid assignments (over 
these CNs) of weight em is given by 



N, 



(7™) 



(em) = Coeff 



(aW(.)) 



7 m 



,x'- 



where Coeff [p{x),x'^] denotes the coefficient of x'^ in the 
polynomial p{x). We now use the following result, which 
appears as Lemma 19 in ifTTl : 

Lemma 4.2: Let A{x) = 1 + X]m=c^"'^"' where 1 < 
c < d, be a polynomial satisfying Ac > and Au > for all 
c < u < d. Then, for sufficiently small ^, 



lim - log Coeff 



{A{x)Y,x^' 



e fecA, 



o{e) (13) 



The limit in ( fTST l assumes the inclusion of only those positive 
integers £ for which e Z and Coeff [{A{x)Y , x^^] is 
positive (i.e., where the expression whose limit we seek is 
well defined). A proof of this lemma may be found in the 
Appendix; our proof is based on arguments from (TU] and 
Lagrange multipliers, and constitutes a different approach to 
that taken in ifTTI . 

Applying this lemma by substituting A{x) — A^*''{x), £ = 
7TO and = e/7, we obtain that with 7 fixed, as m — > (X) we 
have, for sufficiently small e. 



ivi,r^ (em) = Coeff [(^A^-'^x) 
exp i^m 




,x 



ertJ^r}^ 



(14) 



'Here we make use of the following general result |20^. Let ai be the 
number of ways of obtaining an outcome j 6 Z in experiment A, and let 
bj be the number of ways of obtaining an outcome j £ Z in experiment 
B. Also let cj; be the number of ways of obtaining an outcome in 
the combined experiment {A, B) with sum i + j = k. Then the generating 
functions A{x) = QiX*, B{x) = J^^. bjX^ and C(x) = J^j, c^x'' are 
related by C{x) = A{x)B{x). 
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B. Number of check-valid assignments of weight Sm 

Next we derive an expression, valid asymptotically, for the 
number of check-valid assignments of weight Sm. For each 
t G Ic, let ctm denote the portion of the total weight Sm 
apportioned to CNs of type t. Then ej > for each t e Ic, 



and J2tei — Also denote e — (ei 62 



= )■ The 



number of check-valid assignments of weight Sm satisfying 
the constraint e is obtained by multiplying the numbers of 
check-valid assignments of weight etm over 'ytm CNs of type 
t, for each t ^ Ic, 

N(^\Sm)^l[N!:jr\etm) 

tela 

where the fraction 74 of CNs of type t E Ic is given by (|4]l. 

As n ^ 00, we have m ^ 00 and so we obtain using (fl4l i 
that for sufficiently small S, 




(15) 



The number of check-valid assignments of weight 6m, 
which we denote Nc{5m), is equal to the sum of Nf\Sm) 
over all admissible vectors e. However, the asymptotic expres- 
sion as n cx) will be dominated by the distribution e which 
maximizes the argument of the exponential . Therefore, our 
next step is to maximize the function 

/(e = X - log — 7^ 



subject to the constraints 

5(e) = J2^t = ^ 



tela 



and 



et > yte Ic 



(16) 



(17) 



We solve this optimization problem using Lagrange multipli- 
ers, ignoring for the moment the final constraint. Since 

det n \et f pj ' det 



1 



for all t £ Ic, we have to solve the Uc equations (where /i is 
the Lagrange multiplier) 



1 , f PtC't 

— log 7^ 

n \etj p 



together with (fTST l. for the (n, 
(Hg yields 

PtCt 



Ip 



f = yteic (18) 

- + 1) unknowns {/i, e}. First, 

Vi e Ic 



^Obsei've that as m — > 00, ^^exp(mZt) — > exp(m maxtjZt}) 



where z = e^. Now using ( fT6l ), we obtain 



tPtZ 



tela 



The left-hand side of this equation involves a sum of positive 
terms. For S sufficiently small, we may approximate 



T~ Pt^' 
Jp ^ 



tz' 



tela 



} P ^ 



C 



tz' 



teXa 



(19) 
(20) 



Applying this approximation, we obtain et — if t ^ Xc, and 
et = KptCt if t G Xc, where K is independent of t. Then 
(fTSI l yields K — S/C, and we obtain the solution 



PtCtS/C ift^Xc 
otherwise. 



This solution satisfies ( fTTI l. When substituted into ( fTsT i, it 
yields the following result: as — > 00 



Nc{5m) — > exp < m 



r j P 



0{S^) 



(21) 



C. Number of variable-valid split assignments of split weight 
(rn, (jn) over "/n VNs of type t G /.„ 

Consider VNs of the same type t £ ly. We now evaluate 
the number of variable-valid split assignments (over these 
VNs) of split weight {Tn,an). Using generating functions , 
this is given by 



A^i'^"^ (rn, an) ^ Coeff ( B'^'' {x, y) 



where Coeff [p{x,y), x'^y'^] denotes the coefficient of x'^y'^ in 
the bivariate polynomial p{x, y). We make use of the following 
lemma from fTOl Theorem 2]. 

Lemma 4.3: Let 

fe d 

u— 1 v—c 

where fc > 1 and 1 < c < d, be a bivariate polynomial 
satisfying Bu.v > for all 1 < u < fc, c < u < d. 
For fixed positive rational numbers ^ and 6, consider the 
set of positive integers £ such that ^£ G Z, 6i £ Z and 
Coeff [{B{x,y)Y , x^^y^^] > 0. Then either this set is empty, 
or has infinite cardinality; if t is one such i, then so is jt 

■^We use the following result on bivariate generating functions 1201 . Let aij 
be the number of ways of obtaining an outcome G in experiment A, 

and let bk^i be the number of ways of obtaining an outcome (fc, I) G Ip in 
experiment 13. Also let Cp^q be the number of ways of obtaining an outcome 
{{i, j), {k, I)) in the combined experiment {A, B) with sums i + k = p 
and j + I = q. Then the generating functions A{x,y) = j o,ijx''y^ , 
B{x, y) = Y.kl bk,ix''y' and C{x, y) = J2p q Cp.qxPyi are related by 
C{x,y) = A{x,'y)B{x,y). 
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for every positive integer j. Assuming the latter case, the 
following limit is well defined and exists: 



lim ilogCoeff {B{x,y)Y 



= max V 77,jlog(^) (22) 

where S = E I? : Bi^j > 0}, r; = ('7ij)(ij)es. and 

the maximization is subject to the constraints ^j.^ --^^^ r/ij = 

1' E(ij)eS^'?»J = E(jj)esi^»j = ^ and 77,^ > for all 
ii,j)GS. 

Applying this lemma by substituting B{x,y) ~ B'-'^\x,y), 
I = 'yn, ^ = t/j and 9 = a/^, we obtain that with 7 fixed, 

as ri —> cxD 



(23) 



Nij\Tn,<jn)^Coeff \^(^B^*\x,y) 

max ^ ^giog('4f)i (24) 
.{nX^)(T,a)} (25) 



cxp < 71,7 max 



cxp ■ 



where the maximization over rj^*^ = iVi^j){i.j)eSt subject 



.it), 



to the constraints E(,;j)es* = 1. X;(*,i)GSr = t/j, 
E(i,j)eS7 J'^/lj = and ?7,|*] > for all e 5* (recall 
that the sets St and S^T are given by (O and (|9]l). 

D. Growth rate of the weight distribution of the irregular D- 
GLDPC code ensemble sequence 

Recall that the number of check- vaUd assignments of weight 
5m is Nc{Sm); also, the total number of assignments of weight 
Sm is (^^) . Therefore, the probability that a randomly chosen 
assignment of weight 5m is check-valid is given by 

Pvaiid(<5m) ^ Nc{6m) j 

Here we adopt the notation 5m — Pn; also we have 
E — m/ J p = n/ J X. The binomial coefficient may be 
asymptotically approximated using the fact, based on Stirling's 
approximation, that as n ^ 00 fTT| 



rn 
an 



exp|n crlog (^^^ + 0(cr2) | 



(valid for < a < t < 1) which yields, in this case. 



n/jX 
I3n 



exp < n 



as n 00. Applying this together with the asymptotic 
expression ( |2TI ). and assuming sufficiently small (3, we find 
that as n ^ 00 (exploiting the fact that 6 J p — f3 J X) 



P..M{Pn) ^ exp{nr(/3)} 



(26) 



where 



y(/3) = log 

r 



3C 



/3/A 



/31og 



/3/A 



Next, we note that the expected number of D-GLDPC 
codewords of weight an in the ensemble A^„ is equal to the 
sum over (3 of the expected numbers of split assignments of 
split weight (an, (3n) which are both check-valid and variable- 
vaHd, denoted A^^;'^„: 



/3 



This may then be expressed as 



13 



Yl oit=a 



where the fraction 5t of VNs of type t e /„ is given by (|5]l 
and the second sum is over all partitions of a and /3 into 
n^ elements, i.e., we have at,Pt > for all t e /„, and 

Now, using (l23]l-(l25ll. as n ^ 00 we have for each t E Iv 



Ni'r\atn,f3tn)^exp{nX^t''\at,(3t)} , 
where, for each t E Iv, 

Xf')(a„/3,)=<5*max ^ r;!*] log ^ (27) 



and the maximization over r]^ > = (ili j ){i.j}eSt subject to 
the constraints 



E 



(t) 



1 



(i,i)esr 



E- (t) 



and 



'^{i,j)E St 



(28) 



(29) 



(30) 



(31) 



Therefore, recalling ( |26] l. we have that as n ^ 00, 



E E ^^p' 



/3 Z]at=Q! 



(32) 



Next, for each t e /u we define 



FtinW)^yi%\og(^)^ E ^ 



(t) 
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Note that the expression (|32] i is dominated as n ^ oo by the 
term which maximizes the argument of the exponential. Thus 
we may write 



^i:U)esr 3^ = 7g > for all j) G . We 

observe that this maximization may be recast as 



G(a) — max max < > (5t max 



(»,i)es; 



(t) 1 
Vi. log 



(t) 

%3 



Ftiv 



(^)^ 



-/31og 



/3/A 



+ 0(/32)l (33) 



where the maximization over r;*^*^ = (jyl*-) 



(for each 



and (130b together with 



i £ /u) is subject to constraints 
??g>Oforall {i,j)eS^. 

We next have the following lemma. 

Lemma 4.4: The expression X^te/ ^tFt{'ri'^^'^) is 0(q! 
for any ry^*) satisfying the optimization constraints 



A proof of this lemma is given in the Appendix. It follows 
from Lemma 14.41 that the expression X^te/ ^tFtiv^*''^) 
O(a^) for the maximizing 77'*^ Also, since (3 /a is bounded 
between two positive constants, any expression which is O{0^) 
must necessarily also be 0{a^). Therefore 



G(a) — max max 



: max Tif] log 



(*)- 



13 ( eC 



/31og 



e 



(t) 



where the optimization is (as before) subject to the constraints 
(|29] l and ® together with ry|*] > for all e 5^7. 

In what follows, for convenience of presentation we shall 
temporarily omit the 0{a^) term in the expression for growth 
rate. 

Next we make the substitution 7^ j' = ^tvf] for all t G Iv, 
£ Sf^ . This yields 



G(a) — max max 



max 



(t) 



(t) 



log 



B ( eC 



/31og 



where the maximization over 7 



(7«) 



t G /^) is subject to the constraints j)es- *7i j 



(for each 

t) 



at. 



^Here we use the following standai'd notation: the real-valued function f(x) 
is said to be 0(g{x)) if and only if there exist positive real numbers k and 
e, both independent of x, such that 

\f{x)\ < kgi^) VO < X < e . 



G{a) — max 



^ 7ij- 



log 



/3(7)/A 



where the maximization, which is now over 7 = 
{lf])tei (ij)eS^' subject to the constraints 

„(*) 



E E = " 



and 7!*- > for all t e /i,, (i, j) G 5j , and where 

/3(7)=E E M^ 



Making the substitution = 7,^-^:' /a for all t £ I^, G 



(t) 



5j , we obtain 



G{a) — a max 

V 

z{y) 



E E 4ii°g — —] 



+ 



■log 



eC 



z{v) log 



az{i') J \ J \Q!z(i/)jA^ 
where the maximization over 1/ — {^'f])t^i (j j)es" subject 



to the constraints '^tei.^(i,j)<^s' ^^f] ^ ^ ^"'^ '^ij - ^ for 
all i G Iv, ihj) G S'j^, and where 



,(*) 



K-)-E E 



it) 



Assuming the condition r = 2, we may write 

G{a) = a max {Ki (v) + K2{v>) log a) 

where 



Next, assuming the condition p = 2, we make the observation 
that 

^H-E E ^-S>2E E ^ 

with equality if and only if vf'^ = for all t £ ly, {i, j) G 
with j > 2. Therefore K2{i') > with equality if and only 
if iypj = for all t e ly, G S^^ with j > 2. Let i/i and 
1^2 be two distributions satisfying the optimization constraints, 
and suppose that 1^2(1^1) > and K2{v2) = 0. Then for 
sufficiently small a, we must have 

Kilui) + K2{vi) loga < Ki{i'2) + ^^2(1^2) loga . 
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This follows from the fact that the inequaUty 

K2{vi)loga < Ki{v>2) - Ki{vi) 

will always be satisfied for a sufficiently small (since 
log a — cx) as a — > 0, and recalling that K2{i'i) > 0). 
Therefore, for sufficiently small a, the vector v which 



,(*) - 



for 



maximizes Ki{i>) + 7^2(1') log a must satisfy ^ 
all t £ ly, {i, j) G with j > 2. Note that this impUes that 
the maximum, and hence the growth rate, depends only on 
the check and VNs with minimum distance equal to 2. Also, 
recall that for each t e Xy, the set ij = {i e Z : i?| 2 > 0}; 
we contract the vector u to include only variables i^^^^ where 
t G Xy and i £ Lt (since only these may assume positive 
values). 

The growth rate may be written as 



G{a) 



where 



a max 



s{v) log 



1 



2C/A 

and where the function s(y) is given by 



^ amax(logi?(iy)) (34) 
(35) 



s(v) 

The maximization over v 
to the constraints 



t6X„ iGLt 



(36) 



^i^2)tei^,ieLt in dSll is subject 

(37) 



tG/„ i£Lt 



and 



iyli>0 yteXy,ieLt 



(38) 



Let the vector v which maximizes (l34l l be denoted by P. Then, 
our task is to show that 

1 



P-1(1/C) 



i.e., that 



(39) 



where the parameter C and the polynomial P{x) are defined 
in ( [Tol l and ( fTTT ). respectively. We show this using Lagrange 
multipliers, ignoring for the moment the constraint ( l38b . We 
have 



(91ogi?(l/) 



it) 

1.2 



= log 



log 



s{i')\ dh{u) 



dv, 



it) 

i,2 



SO that, at the maximum. 



log 



log 



Xi 



for all t £ Xy, i £ Lt, and for some Lagrange multiplier 
A e R. Substituting back into (OHi and using (O yields 



logR^Y. E'^S (a* -log 



+ s{u) log ( ^ ) = A (40) 



i.e., the maximum value of the function logi?(i>') is equal to 
the Lagrange multiplier Thus we have 



{RY 



s{£')6t 



for all t G Xy, i £ Lf. Substituting this into the LHS of 
and recalling the definition (fTTT i. we obtain 



EE 



2A. 



-it) 



Cs(u) 



1 



where we have used (|5]i, (l35T l and ( |36] |. This completes the 
proof of the theorem. Note that ( fT2l l is a first-order Taylor 
series expansion around a = which directly generalizes 
the results of 1 11] and 1 15] (for irregular LDPC and GLDPC 
codes respectively) to the case of irregular D-GLDPC codes. 
Our result indicates that for this case also, the parame- 
ter 1/P~^(1/C) plays an analagous role to the parameter 
A'(0)p'(l) for irregular LDPC codes, and to the parameter 
A'(0)C for irregular GLDPC codes. 

V. Conclusion 

An expression for the asymptotic growth rate of the weight 
distribution of D-GLDPC codes for small linear-weight code- 
words has been derived. The expression assumes the existence 
of minimum distance 2 check and variable nodes, and in- 
volves the evaluation of a polynomial inverse, derived from 
the minimum distance 2 variable nodes, at a point derived 
from the minimum distance 2 check nodes. This generalizes 
known results for LDPC codes and GLDPC codes, and also 
generalizes the corresponding connection with the stability 
condition over the BEC. 

Appendix 
Proof of Lemma|4.2| 



First consider the set of positive rational numbers I such 
that ^£ e Z and Coeff {{A{x)Y,x^^) > 0. Then it is easy to 
see that either this set is empty, or it has infinite cardinality; if 
t is one such £, then so is jt for every positive integer j (proof 
routine by induction). The former case is not of interest to us 
here. In the latter case, the following limit is well defined and 
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exists if TOl Theorem 1]: 

lim ilogCoeff \{A{x))\x^'^ 



max 



E A log 9^ (41) 



where S = {i e 'L : > 0}, (3 = {f3i)i^s, and the 
maximization is subject to the constraints 



5(/3)-5]ft = 1 

ies 



and 



P^>0 Vies 



(42) 
(43) 

(44) 



We solve this optimization problem using Lagrange multi- 
pliers, ignoring for the moment the final constraint. Defining 



(45) 



we have 



9/3, ^\el3j ' 9/3, ' 9/3, 
for all i e 5. Therefore we obtain 
A, 



(46) 



for all i e 5, where A and /i are Lagrange multipliers. These 
equations, together with (l42l l and ( |43] ), yield ( 15*1+2) equations 
in the (IS"] + 2) unknowns {A,^,/3}. Setting i = in ( |46] l 
yields 

and substituting this back into ( |46] l gives 

/3, = /3oA,z* 
for all i G S, where z — e'^. So from ( l43T l 

/3oEi^,z* =^ 

Now for sufficiently small ^, we may approximate 

/3o E iA,^' « fiocAcz" . 
ies 

Applying this approximation, /3,; is nonzero only for i G {0, c}. 
Therefore, from (|42] | and (l43T l we obtain the solution 



1-C/c ifi==0 
l3i = { i/c if i = c 

otherwise. 



(47) 



It is easy to see that this solution satisfies (|44] |. Finally, 
substituting the solution (|47] | into ( l45T l gives 

ma./OT ^ (|-l),„g(l-|)+i,„g(£|l 



C 1 ( ecA, 



or) 



This completes the proof of the lemma. 

Proof of Lemma |4~4] 
Consider any 77^*^ which satisfies the optimization con- 
straints (I28]l-(l3ni. Since a = X^te/ ^t, ct small implies that 
at is small for every t G ly. From constraint ( |29] l we conclude 



that rif^- is small for every t £ /„, (i,j) G S'^ , and so 77q*q 



is close to 1 for all t G 1^. Formally, for any t G ly the term 
in the sum over rj'*^ in dZTl l corresponding to {i,j) ~ (0,0) 
may be written as (here we use ( |28] l, and the Taylor series of 
log (1 — x) around a; = 0) 



= E %j 



O 



E 



Therefore we have 



it) 



(ij)6-S- 

for some kt > independent of {?7,|*j}(j j-^^g 



(48) 



It follows that 



<E^*h(^^")|^^E^K E 

te/„ te/„ (i,i)GS," 

(49) 

where S[ — kfSt for each t G /u. Also, by (|29] | we have 
S(i 5)es- ^f] - "t/*^* therefore 



J:4 T. '£'1 < 



(50) 



Denote 6 ~ maxtg/^, {(5(/(5( }; then, combining ( |49] l and ( fSOl l. 



<'5E-?<'5fE«*) 

te/„ \te/„ / 



and thus the expression 

Ete/ StFt{ri^^y) is 0(a2), as desired. 
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